Armin Ronacher tests Pangram, an AI detection tool, by having an LLM generate text based on a detailed prompt, then manually rewriting it from scratch without AI assistance. Both versions get flagged as 100% AI-generated, suggesting that detection tools struggle with text that originated from LLM-structured prompts even after substantial human revision.

• Pangram claims extremely low false positive rates (0.0041% false AI accusations), yet flags clearly human-authored text as entirely AI when the author used an LLM to develop the initial structure
• The rewritten text shares only 50% similarity to the LLM output with no identical sentences, yet still scores as 100% AI, indicating detection models may penalize writing that follows LLM-suggested structural patterns
• Authors who rely on LLMs for organizing ideas face a credibility problem: their work gets flagged as AI regardless of how much manual editing and rewriting happens afterward